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O ■ Abstract 
(N 

^ I We derive conditions under which alternating renewal processes can be used to construct cor- 

Q ' related Poisson processes. The pairwise correlation function is also derived, showing that the 

I resulting correlations can be negative. The technique and the analysis can be extended to the 

' generation of two or more dependent renewal processes. 

(N 

1 Introduction 

Bruce Knight first suggested using specially chosen alternating renewal processes to construct cor- 



. related Poisson processes. An alternating renewal process has successive intervals drawn in turn 

from one of two probability distributions. For example, interval zj^^ is drawn from Pi{t) and 



C/3 

I from P2{"^) independently of the first. Process construction continues in this fashion. To derive 

r-i ■ dependent renewal processes, events in the alternating renewal process are assigned to one or the 

other, with events ending intervals drawn from process 1 assigned to one (call it process A) and 
events ending in process 2 intervals assigned to the other (process B) (Figure [T|l. Note that the sum 
of successive intervals, no matter which pair is chosen, has the probability distribution p{x) given 
QT) • by pi (t) ★ P2{'^), where * denotes convolution. Thus, the result if Knight's construction is, in gen- 



> 



eral, two statistically dependent, identically distributed renewal processes. To make each member 
^ \ of the pair be Poisson, p{t) must be exponential: p{t) = Xe^^''^u{T). 

2 Analysis of the Method 

■ The requirements for the component interval distributions to achieve dependent Poisson (dependent 

renewal as well) are best expressed in the frequency domain using moment-generating functions. 
Defining 

M,{s)= / p{z)e"dz, 
Jo- 

we have M^{s) = Mi{s) ■ M2{s). Thus, to construct dependent renewal processes, we need only 
chose the desired interval distribution and find two interval distributions that satisfy this constraint. 
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Process A ^ 



Process B n ^ \ ^ 



^ 



Figure 1: An alternating renewal process consists of a sequence of interval pairs t^'^t^'. Each member 
of the pair and the pairs are statistically independent stochastic quantities. Dependent renewal processes are 
derived by assigning intervals ending in an interval drawn from interval distribution 1 to one process (here 
process A) and those ending in an interval drawn from distribution 2 to the other 

The tricky part is not satisfying the constraint, but rather insuring that the two components corre- 
spond to interval distributions (i.e., they cannot be negative). 

For dependent Poisson processes, each of which must have M^{s) = 1/(1 —s/X), Knight's 
specific suggestion is the choice 

My{s)= ,, M2{s) ^ 



{\-s/X)s^ {l-s/Xyi 

Each is a viable interval distribution, and to produce dependent Poisson processes, we only need 
^1 +^2 = 1- Daniel Fisher's suggestion is more complicated. 

Clearly, the product of the two is 1/(1 — s) and does generate Poisson processes like Knight's 
procedure having an average rate of one. As we will show, this construction is overly complicated. 

3 Correlation Function 

Quantifying the dependence between the generated processes can be expressed by the cross- 
correlation function defined as 



Ra,b{^) 



dNA.t dNB,t+z 
dt dt 



,T>0, 



where Nt is the counting process, defined as the number of events that has occurred up to time t. The 
derivative of the counting process creates impulses at each event occurrence. The cross-correlation 
can be explicidy calculated for any M\{s), M2{s). To find /?a,b(t) for T < 0, we evaluate /?ba('Z^) 
for T > 0. The expected value is interpreted as the probability of an event occurring in process B 
at time f + T given that an event occurred in process A at time t multiplied by the probability of an 
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event occurring in the first process at time t. Expressing the cross-correlation function as a function 
of T only means that the processes are jointly stationary. 

As an example of how the covariance function can be computed, consider the auto-correlation 
function of a renewal process. The required conditional probability equals the sum of the probabil- 
ities that k events occur between times t and t + x when an event occurs at time t + x. For A: = 0, the 
conditional probability equals the interval distribution. For k = \,it equals the probability that two 
intervals sum to T. For any k, the conditional probability equals the probabihty k+ \ intervals sum 
to T. These probabilities amount to the A:-fold convolution of the interval distribution with itself, 
which is most easily calculated using the moment generating function. 

k-l 



Therefore, 



Here, X is the average rate at which events occur. For a renewal process, A = 1/E[t]. As a check, 
consider the Poisson process, in which M^(j) = — j). In this case, X = X and the transform 
of the correlation function equals 

— 

A—s 

The inverse transform of this quantity is the unit-step: Ra^{t) = A^u(t). By subtracting the square 
of the mean event rate we obtain the covariance function, equal to zero in this case. This result ex- 
presses the fact that a Poisson process is white noise. The general expression for the autocovariance 
function is 

MJs) V- 
\-M^{s) s 

Returning to the cross-correlation function, we need the conditional probability of an event 
occurring in process B at time t + T given that an event occurs in A at time /. Because the alter- 
nating renewal method creates Poisson processes from renewal processes, we can use the moment- 
generating function technique here as well. The first term {k = 0) corresponds to the interval dis- 
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tribution between an event in the reference process and the next event in the other. Because of the 
construction method, this interval is determined by one of the component process's interval distri- 

(2) 

bution, T> . The next term in the cross-correlation function corresponds to the convolution of this 
interval distribution with the interval distribution of the derived Poisson process. The third term 
corresponds to the convolution of the second process's interval distribution with convolution of the 
Poisson process's interval distribution with itself. Thus, 



Ra,b{^) 



lY,M2{s)[M,{s)f = 1 
k=0 



M2is)+M2is) 



M,{s) 



l-M^{s)_ 



■ XM2{s) - —M2{s) , 



the latter equation being the only one employing the Poisson assumption. Adding A^/j, we obtain 
the Laplace transform of the cross-covariance function. 



^2 

KaM ^ lM2{s) - — {M2{s) - 1) 



Once inverse-transformed, we can judge whether the two processes are positively or negatively 
dependent. Note that to obtain the expression for negative T, we simply replace M2{s) by M\{s). 
For Knight's example, the covariance function equals 

Xs+^-cS-^e'^^ -X'^T{gM) 



Here, r( ) is the Gamma function and r(-, ) is the incomplete Gamma function. Plotting this 
quantity for several values of g and X indeed confirms his statement that the two Poisson processes 
are positively correlated. 

For Fisher's example, the covariance function equals 



^e-«^(2a2 -{g + a) +a{a-\){g-a)x) + t > 

S^e+s^{g + a + g{g-a)z), T<0 



Note that his construction has A = 1, which means the exact role of A is hidden. In any case. 
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this expression indicates that negative correlations can occur for many choices of a,^. For T > 0, 
negative correlations can occur for T less than a{a-\){g-a) ' < O5 they can occur for t less than 
— gf^"a) • Consequently, the negative correlations can occur only for lags T asymmetrically located 
about the origin. 

A whole host of examples follow from this framework. We know that we must have 

A 1 

M2{s) 



X—s Mi{s) ' 

For each suggested Mi [s), we must check the range of parameter values over which M2{s) is a valid 
moment generating function: its inverse transform must be non-negative. Now armed with a valid 
alternating renewal process, we can investigate the dependence structure of the derived Poisson 
processes. 

Example. If Mi {s) =a/{a — s), we must have a > A for pii'c) > 0. In this case. 

Thus, the two Poisson processes are positively correlated. 
Example. More interesting is the example 



. a2 ai-s 

Mi{s) = 

ai a2 — s 



The corresponding interval distribution is 



p,{T) = ^[{ai-a2)e-"^M'^) + 5{T)] , 



which demands that ai > 02- The interval distribution corresponding to M2{s) is 

a2{ai-X) 



P2(t) = ^""'^ [(ai - a2)e-"'^ + (A - a2)e-^'] u(t) 
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which requires ai > A > 02 to be positive. We obtain 




Ka,b{t:) = < 




Here, negative correlation occurs for positive lags, positive correlation for negative lags. Also note 
the presence of the impulse in the correlation function, a direct consequence of the impulse in 
process 1 's interval distribution. 

4 Summary 

These results provide an analytic prediction of the correlation between Poisson processes con- 
structed from alternating renewal processes. The technique is not restricted to Poisson processes; 
correlated renewal process can be generated as well. The two component renewal processes must 
be chosen so that the convolution of their interval distributions equal the desired one. Furthermore, 
more than pairs of dependent renewal processes can be generated this way and analytic expressions 
for the correlation functions derived by simply extending the approach described here. 

One limitation of this method is how to construct dependent non-stationary Poisson processes. 
Doing so requires the underlying alternating renewal process to be time-varying. It is difficult to 
construct such processes and even more difficult to analyze the cross-correlation function between 
them. 

From a formal viewpoint, the resulting Poisson processes constructed from an alternating re- 
newal process are not what a probabihst would term jointly Poisson. Analogous to Gaussian random 
variables that are jointly Gaussian, jointly Poisson processes have special analytic properties. The 
defining characteristic of jointly distributed random variables that enjoy special status as Umiting 
distributions — the Central Limit Theorem in the Gaussian case and the superposition of point pro- 
cesses converge in the limit to a Poisson process— is infinite divisibility. This concept requires that 
the quantity in question always be expressed as a sum of an arbitrary number of constituents that 
have the same distributional form {i.e., they differ only in parameter values). It has been shown 
that two jointly defined Poisson processes NA,t and Ns^t that are infinitely divisible can always be 
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constructed by 

where A^i ^ and A^2,f are statistically independent Poisson processes and is another Poisson pro- 
cess statistically independent of the others but shared in common between the constructed pro- 
cesses. Consequently, the correlations between the processes /Va,? and Ns^t occur because of the 
common Poisson process component, which means simultaneous occurrence of events produces 
the correlations. These dependencies thus have two important properties: (1) Correlations must be 
non-negative and (2) occur simultaneously, meaning the two process's cross-correlation function 
has no temporal extent. Consequently, jointly Poisson processes share only one property with those 
created from an alternating renewal process: the marginal (individual) point processes are Poisson. 
Although this construction method might prove useful, analytically deaUng with it or its variants 
will be difficult. Generating non-Poisson renewal processes this way may be more fruitful, but the 
theory of jointly defined renewal processes is undeveloped. 
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